Skip to content

Drop requests dependency and optimize data_loader #395

New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

Merged
merged 4 commits into from
Jun 6, 2025

Conversation

Zaczero
Copy link
Contributor

@Zaczero Zaczero commented Jun 6, 2025

Related Issue(s):

  • requests was only required for data_loader, replaced it with httpx
  • there were a few inefficiencies in handling large numbers of files
  • json package was replaced with orjson as it's part of the core
  • except requests.ConnectionError blocks were removed as they obfuscated real error messages and muted app failure exit codes, making it difficult to integrate
  • added is_file checks to avoid consuming directories with weird names

@jonhealy1
Copy link
Collaborator

@Zaczero looks great - just one thing - changelog

@Zaczero
Copy link
Contributor Author

Zaczero commented Jun 6, 2025

I'll do that after the other PR gets merged. I think there will be a merge conflict otherwise, so twice the work (or am I wrong? - I simply don't know).

@jonhealy1
Copy link
Collaborator

I often fix the merge conflicts with the changelog here, don't worry about it. Always better to add the changelog right away or people forget I think.

@jonhealy1
Copy link
Collaborator

Thanks!

@jonhealy1 jonhealy1 merged commit 69590cd into stac-utils:main Jun 6, 2025
15 checks passed
Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment
Labels
None yet
Projects
None yet
Development

Successfully merging this pull request may close these issues.

2 participants